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ABSTRACT 


Minimally invasive surgery (MIS) is one of the most challenging tasks in 
surgical procedures due to the lack of visibility of the surgical area, 
instrument orientation, and depth perception. A tele-operated robot assisted 
minimally invasive surgery is developed to enhance a surgeon's hand 
dexterity and accuracy. To perform MIS, the surgeon controls a slave 
manipulator via a master manipulator, so the force feedback and motion 
feedback are required to imitate an amount of action and reaction force 
between master and slave manipulator. The complicated MIS requires more 
complex surgical manipulator with multi DOFs and multiple force feedback. 
The limitation of multiple DOFs force feedback is a bandwidth of torque 
sensors. Therefore, this study proposes a sensorless based 5-DOF bilaterally 
controlled surgical manipulation. In this research disturbance observer 
(DOB) is used to identify the internal disturbance of the system, which is 
used to estimate the reaction torque. This research mainly focuses on a 


5-DOF bilaterally controlled surgical manipulator to maintain a position and 
additional force. The result of torque error in contact motion is less than 2%, 
the non-contact motion error is not over 5%, and it is evident that the error is 
always less than 0.3% for the position response. 
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1. INTRODUCTION 

Surgeries are always frightening to everyone, whether it is a child or an adult. The surgeon has to 
make a large cut in the body for transparency so that he can perform the operation successfully, which may 
leave scars in the body as a ‘symbol of memory’. Fortunately, by the invention of minimally invasive surgery 
(MIS), surgeries became more safer with limited size and number of cuts or incisions [1]. As MIS is very 
popular among doctors and patients, researchers have proposed many modifications to improve the technical 
skills of surgeons [2-5]. However, the mechanical and technical nature of the equipment limits the visibility 
of the organs, degree of motion, depth of the incision and hand-eye coordination in MIS. Also, loss of haptic 
feedback restricts the surgeon to realize a touching sensation of organs which may lead to internal injury [6, 7]. 
Further, the primary surgical tool insertion in MIS requires high precision and micro-level accuracy on the 
positioning. This role of fine manipulation is limited by tremor and drift in physiology.To overcome all these 
human functionality limitations, robotic assistance is the best option as it 1s unaffected by those factors [1, 8-13]. 

Recently, the surgical robots that assist surgeons have become the significant focus of robotics 
research. Particularly, there are many interests of robotic research in common with a neurosurgery field [8-13]. 
In a robotic assisted MIS, there will be the master manipulator used by the surgeon to provide motion 
commands to the slave who will perform the actual task. The existing manipulators limit the degree of 
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motion to 3-DOF which restricts the flexibility of the movement commands given in the master end. Thus, 
considering limitations of degree of motion in 3-DOF robotic assistance, this study proposes a sensorless 
based 5-DOF bilaterally controlled surgical arm. 

The trouble with a bilateral controlled robotic system is that it results into an unbridled internal 
configuration [1, 14]. It is because it operates via both systems simultaneously and therefore, dynamic 
systems to be incoperate with the bilateral control system. In dynamic systems, task and posture are 
uncoupled and acontrolled independently, thus enhancing the operational capabilities. Bilateral control 
system involves the principle of action and reaction as shown in Figure 1. The slave device operated via the 
master device. The feedback required to the Master device requires amount of the force along with motion 
feedback [15-17]. The force sensor having limited bandwidth when added to the slave device transmits 
reaction forces [18]. For the torque sensation, the disturbance observer (DOB) is included and it is effective 
against disturbance compensation and is required for reaction torque estimation. The force controller 
determines the torque of the reaction when sensing the system's internal disturbance by the the cutoff 
frequency [19]. 
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Figure 1. Action and reaction with remote sensing 
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Improving the operating capability of the bilaterally controlled surgical arm is the emphasis in this 
research. Obaid et al. [20] in the said case, the movement of the system is isolated into a compelled course 
and unconstrained heading. This is achieved by controlling surgical arm speed. The position, introduction 
and locale of the apparatus tips with respect to one another, change the speed and inner organs in the patient's 
midriff dependent on the robot's workspace. The specialist needs to concentrate on the objective (working 
point), condition (touchy tissues in the working areas) and about the crash of instruments while leading 
surgery. In this study, the central idea is to control the development of the surgical arm amid a neurosurgical 
procedure. Whereas, to maintain a strategic distance from an additional weight on the surgeon is to think 
whether the mechanical arm and apparatus will go past the working space or the instruments will go 
underneath the working parts or is there any clash between the devices and nerves or organs. 


2. RESEARCH METHOD 
2.1. DC motor model 
Applying Kirchoff s Voltage Law to the DC motor equivalent circuit, shown in Figure 2. 


ref 


V, = L + RI! +e, (1) 
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Figure 2. DC motor equivalent circuit diagram 
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The control block diagram of the PMDC motor depicted in Figures 3 and 4 where the motor torque 
expressed as, 


Tm = J +T; + Bo +T, (4) 


where, 
J =Inertia of the motor 
B =Viscous friction coefficient 
T, =Load torque 
T; =Static friction torque 
w =Angular speed 
k; =Torque constant 


V, + 


a 






Back Emf 


Figure 3. Block diagram of DC motor 


The (4) expressed as, 
JÖ = Tmn —T, (5) 


JÖ = KE” -T, (6) 





Figure 4. Block diagram of a servo motor 


where, T, mentioned in the Figure 4 is a sum of external torque, inertia torque, and torque generated from 
viscous and coulomb friction. 


Ti = Tint + Text + (T; + BO) (7) 


where, 

Tint =Inertia torque and gravity effect 

Text =External torque 

Ts =Static friction 

BÔ =Viscous friction 

The reference current ree is the input for the motor and PWM voltage pulses are responsible 
for the control of the motor. For correct functionality, T, must be compensated, as the motor torque T; 
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cannot be directly controlled using a . As the torque T,disturbs the output torque, it is also termed as 
‘Disturbance Torque’. Hence, ‘Disturbance Observer’ is introduced to measure this disturbance torque and 
compensate it [19]. 


2.2. Disturbance observer modelling 

The (4) consists of a couple of parameters torque constant and motor inertia, which can be changed 
because of several properties. Similarly, because of the mechanical configuration of the motion system, the 
inertia might also change. In the case of the torque coefficient, it changes with respect to the rotor position of 
the electric motor, which causes the irregularity in the distribution of the magnetic flux throughout the 
surface of the rotor [15, 19]. 


J=J nt AJ (8) 
where; 
Ja =Nominal inertia 


AJ =Inertia variation 
Kın =Nominal torque coefficient 
AK, =Variation of torque coefficient 
By substituting (8) and (9) into (4), (10) is obtained. 
Un + ANG = (Kin + AK IQ” — T, (10) 


By rearranging, 


InO = Kla” — (T, + AJÖ — AK, IG”) (11) 


where; 
Tais : Disturbance torque 


Therefore, 
Tais = Tint + Text + (f + DO) + AJË — AKL, (12) 


Apparently, the disturbance torque comprises all the external torques, internal torques, friction 
torques and torques due to parameter variations and all of them compensated so that the accurate output 
torque obtained. From (11) T4is can be calculated as (13): 


Tas = Kel = Jp (13) 


The unknown value of Tj;,;can be calculated using the known values at the right-hand side in the 


(13). Using the velocity response @ and the torque current pet , the estimated disturbance torque7,;, is 
obtained. As shown in (14), the estimation is done through a first-order low-pass filter, where qis represents 
the cut-off frequency of the low-pass filter. Low-pass filter to filter the noises generating from the 
differentiation [20]. 





Pais = 1# Tais (14) 


The (14) represented in the form of a block diagram. In (12) and (13) demonstrated as a block 
diagram as shown in Figure 5. This structure comprises of a differentiator, which will escalate the noise. The 
implementation of the disturbance observer in the DC motor observed in the following Figure 6. 
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Figure 6. Block diagram of the disturbance observer 


2.3. Reaction torque observer modeling 

The significance of the disturbance detected in practical application is observed as disturbance 
compensation as well as in the reaction torque estimation [1, 21]. Without using a torque sensor, the 
disturbance observer can identify the internal disturbance of the system and also estimate the reaction torque 
as shown in Figure 7. It is well accounted that their relationship of action and reaction is determined by the 
transmission of force sensation within bilateral control. In this case the disturbance observer starts prompt 
calculation and estimation of the reaction torque by increasing the cut-off frequency. The reaction torque 
observer is considered as a modification of the disturbance observer. 


Tais = Tint + Text + (f + DO) + AJË — AKI, (15) 


The external torque acting on the slave manipulator is considered as the Reaction torque and it 
calculated as: 


Text = Tais — [Tint + (f + DO) + AJÖ — AK IZ) (16) 
Since at the moment of contact, 


Text = Treact (17) 
where; 


Treact : Reaction Torque 
Treact = Tais — [Tine + (f + D6) + AJO — AKI,” ] (18) 


The block diagram of the reaction torque observer is shown in Figure 8. 
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Figure 7. Disturbance observer with the DC motor 
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Figure 8. Reaction torque observer with the DC motor 


The disturbance observer offers numerous advantages including observation of disturbance torque 
and compensation. While a regular force sensor consists of narrow bandwidth, the disturbance observer’ s 
offers relatively wider bandwidth [22]. The force sensor consisting of narrow bandwidth cannot offer 
substantial force sensation and is just able to detect wherever it is implemented. Due to being to operate 
under a smaller sampling time, which increases the observer gain as much as possible, the disturbance 
observer can provide a better alternative with the wider bandwidth. As such, the disturbance observer is 
relatively more appropriate for transmission of force sensation in comparison to the force sensors. 


Bulletin of Electr Eng & Inf, Vol. 10, No. 2, April 2021 : 619- 631 


Bulletin of Electr Eng & Inf ISSN: 2302-9285 o 625 


2.4. Bilateral control modeling 

The bilateral controller controls the responses from both, the master as well as the slave and 
converts it into inputs for each other. To control the slave side, torque/position information from the master 
side is used and vice versa. Thus, it is important to capture the exact torque/position information of the slave 
to provide high transparency to the master side [17, 22]. However, according to control theory, transparency 
and stability cannot achieve simultaneously for bilateral controllers due to the system and environment 
uncertainties. Therefore, a balance is fetched by the bilateral system between transparency and stability. In a 
bilateral controller, force sensors used to detect the force of master as well as the slave and the external 
forces. Strain gauges are one of the common force sensors used in the bilateral controller. However, these 
force sensors have narrow bandwidth and when it is in contact with the motion, the accuracy of the output 
depreciates. In addition, the force sensors can detect only the force around it. Thus, they cannot provide a 
vivid sensation of the force, as it is very difficult to fix the sensors in the places where the force to be 
measured. To overcome these drawbacks, disturbance observer can be used as a force sensor that can provide 
much wider bandwidth and possible to set the sampling time short and the observer gain high. Ohnishi 
et al. [16] have successfully analyzed the bandwidth of force control based on RTOB and the frequency 
bandwidth of sensed force (0-80 Hz). Though due to the resource constraints of the microcontroller to 
provide higher bandwidth and the human interaction with the system is producing lower frequencies, the 
researcher has used lower bandwidth (0-40 Hz) for the study purpose. 

The input to the bilateral system includes not only the force but also the elements of disturbance 
from the environment [1, 23]. To avoid this unwanted addition to the input, a good disturbance rejection 
mechanism is bringing together. Further, through the disturbance observer, robust motion control with 
bilateral control is recognized. For the realization of these objectives, acceleration control is essential. The 
structure of bilateral control is resultant from the law of action and reaction. 

Therefore, when the operator manipulates the master, the slave has to be in the same environment. 
Otherwise, the scaling has to be auxiliary to the input. The following (19) and (20) represent bilateral control 
without scaling in which subscript m denotes master and s denotes slave. 


O0m— 0s =0 (19) 
™ + Ts = 0 (20) 


Both (19) and (20) are transformed into acceleration to attain ideal force and position control, which is 
necessary for a bilateral control. 


Om— @s=0 (21) 
O6m+ 80s =0 (22) 


As the disturbance observer is also used as a force sensor, the sampling time should be as small as 
possible to get a better response [24, 25]. The (21) is known as differential mode, which represents the 
position relationship and (22) is known as common mode between the master and slave system, which 
represents the acceleration and attributed to the sign of equations. Hence, if the force and position combined 
in the acceleration dimension, it is possible to achieve independent control of both of them in a bilateral 
system. Thus, the (21) and (22) are transformed into the following to get the optimal goal of bilateral control 
as shown in Figure 9. 


Om — 0s = Ocom > 0 (23) 


0m + Os = dif > 0 (24) 
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Figure 9. Bilateral control representation 
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2.5. 5-DOF bilaterally controlled surgical arm modelling 

A bilateral 5- DOF robotic system is developed in this research to perform surgical procedures by 
taking into consideration the workspace and the operational movements. The system consists two main units: 
the master manipulator and the slave manipulator with same dimension. The manipulator has 5 degree-of- 
freedom (DOF) with five actuators and three links. The end-effector of the slave manipulator attached with 
the surgical tool, which can carry 0.5 kg. The manipulator is implemented using ROBOTIS smart actuator 
model XM430-W350 and XM540-W270. The actuator is controlled by PID position and velocity control and 
provides feedback on the real-time position, velocity as well as torque. Robot operation system (ROS) 
platform is used as the software control system and user interface. Figure 10 shows the conceptual design of 
manipulator and Figure 11 is the completed manipulator. 





Figure 11. Bilaterraly controlled 5-DOF manipulator 


To command the manipulator, a kinematic relationship is used to generate forward kinematic and 
inverse kinematic of the robotic manipulator. The forward kinematic transforms the joints coordinate (Ø) to 
the Cartesian coordinate (x, y, z). Therefore, the manipulator moves on the Cartesian coordinate (x, y, z) by 
commanding a joint angle in each joint actuator. The inverse kinematic transforms a Cartesian coordinate (x, 
y, Z) to a joint coordinate (Ø). Therefore, the operator commands position and orientation on the Cartesian 
coordinate to control the manipulator joint’s movement. 

Figure 10 represents the homogeneous relationship of the manipulator joint coordinate, which is 
assembled from seven joint coordinates. The base of the manipulator is a fix reference coordinate ({Base}) of 
the system. The {1} coordinate is a revolute joint rotated in z-axis, {2}, {3}, {4} in X-axis and {5} in Y-axis. 
The tip of the surgical tool is a fixed end of the effector coordinate ({ee}). The kinematic of the manipulator 
is calculated based on the homogeneous transformation of the joint coordinate’s relationship shown in (25). 
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3. RESULTS AND DISCUSSION 
3.1. Experiment setup 

The experiment setup was set as short distance teleoperation with a bilaterally controlled master- 
slave system. The master manipulator is installed at the user station and the slave manipulator is placed on an 
experimental environment. Master and slave manipulators are the main units of this experiment in which the 
master side involves human interaction. For an ideal brake by wire control, the position and the torque 
applied at the master end should appear the same as in the slave end. In this experiment, the slave is not in 
contact with any material so that it can move freely. To conduct a contact motion test, the slave is brought 
into an environment where the manipulator comes in contact with an object (Rubber). In the functional world 
the human tissue's tensile strength varies from patient to patient, hence the experiments were conducted with 
materials of rubber types (with an unknown tensile strength value). The experiments were performed under 
the supervision of a Surgeon from Siriraj Hospital, Mahidol University as shown in Figure 12. In order to 
check the stability of the proposed system, the selected material was utilized and it was found that this system 
can be used universally for robot-assisted neurosurgery. The experiments were performed with an observer 
gain (force bandwidth of 0-80 rad/sec). In these experiments, the two different values of gains were chosen 
40 Hz in Figure 13 and 80 Hz in Figure 14. The response of torque and position is shown in Figures 13 and 
14 for both contact and non-contact motion. 





Master 


Slave 





Figure 12. Experimental setup of bilaterally controlled master-slave system 


From the Figures 13 and 14, it is evident that the slave manipulator is closely following the position 
response of the master manipulator with insignificantly smaller position errors as shown in Figure 13 (a), (c), 
(e), (g) and Figure 14 (a), (c), (e), (g) (maximum position error is less than 0.3%). Figure 13 (1), G) and 
Figure 14 (1), G) shows the position response and torque response of end effector (joint 5) is slightly different 
from the other joints because of grasping motion. Figure 13 (b), (d), (f), (h) and Figure 14 (b), (d), (f), (h) 
shows the torque responses of the master and the slave manipulators in different cut-off frequencies 40 Hz 
and 80 Hz, which is exactly the mirror images of each other. The slave manipulator closely follows the 
torque applied in the master manipulator, see Figures 13 and 14. When Figures 13 and 14 is compared, high 
frequency variations of the torque can be observed at a higher cut-off frequency. 

In contact motion, the response of slave manipulator follows as that of the torque applied in the 
master end, see Figures 13 and 14. An error bar is also generated on the top of the torque curve of the 
“master” as shown in Figure 15 (a). So, the test result shows that the torque error in contact motion is less 
than 2% whereas it is less than 5% in non-contact motion. 

Figures 14 (a), (c), (e), (g) and Figure 13 (a), (c), (e), (g) indicates that the position response of the 
slave is similar to that of the master in contact motion. Even though the test shows considerable error in 
position response due to the low proportional gain selected in the controller, it should not be increased 
because of the torque limits of the motor. From the error bar, see Figure 15 (b), it 1s evident that the error is 
always less than 0.3% for the position response. 
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Figure 13. Position and torque response for all the joint (Jı-Js) with observer gain Gais=40 Hz 
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Figure 14. Position and torque response for all the joint (Jı-Js) with observer gain Gais=80 Hz 
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Figure 15. Averaged error response for joints (Ji-Js) Gais=80 Hz, (a) Averaged position error, (b) Averaged 
torque error 


4. CONCLUSION 

The applications of Minimal invasive surgery are increasing day by day, and now surgery is not 
limited to only neurosurgery. In the present situation the surgeons are not excluded from the surgical 
environment, without even considering the safety factors. Therefore, feedback in MIS is a technology that 
has not yet arrived on commercial MIS platforms. But due to current interests and in-depth research it will 
eventually lead to the development of better MIS robots in the future. Even though the bilateral control 
concept was initialized long ago and it is currently being implemented by various researchers all around the 
world, its operationality improvement is not yet developed significantly; hence the initiative was arisen to 
implement operationality improvement. In this study a sensorless based 5-DOF bilaterally controlled surgical 
manipulation was proposed. The DOB is implemented to identify the internal disturbance of the system, 
which is used to estimate the reaction torque. The goal is to bileratlly controlled a 5-DOF surgical 
manipulator to maintain a postion and additional force while a surgeon preforms in MIS operation. The 
position and torque responses were consummate and obtained distinctly for both contact and non-contact 
conditions. During the non-contact condition the position responses of slave manipulator follows the master 
system very closely. A lower torque error shows during the contact motion and the error could be reduced by 
introducing nonlinear control strategies in particular adaptive fuzzy hierarchical sliding mode control for a 
category of MIMO nonlinear time-delay systems with enter saturation. 
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